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1.  Introduction 


Since  Robbins  (1956,  1964),  the  empirical  Bayes  approach  to  statistical  problems 
has  generated  considerable  interest  among  the  researchers.  Empirical  Bayes  procedures 
have  been  extensively  studied  in  the  literature.  To  name  a  few,  Lin  (1975)  and  Singh 
(1976,  1979)  considered  empirical  Bayes  estimation  for  the  one  parameter  exponential 
family,  and  Singh  and  Wei  (1992)  studied  empirical  Bayes  estimation  in  a  nonnegative 
exponential  family.  Johns  and  Van  Ryzin  (1972),  Van  Houwelingen  (1976)  and  Stijnen 
(1985)  studied  empirical  Bayes  tests  for  one-parameter  continuous  exponential  family,  while 
Johns  and  Van  Ryzin  (1971)  and  Liang  (1988)  considered  empirical  Bayes  one-sided  tests 
for  a  discrete  exponential  family.  Empirical  Bayes  procedures  have  also  been  studied  for 
non-exponential  family  distributions,  see  Huang  (1995)  and  the  cited  references  there.  In 
this  paper,  we  study  the  empirical  Bayes  two-tail  tests  in  a  discrete  exponential  family. 
Our  research  interest  is  motivated  by  Wei  (1991)  in  which  an  empirical  Bayes  two  tail  test 
was  investigated. 

Let  X  denote  a  random  variable  arising  from  a  discrete  exponential  family  with  prob¬ 
ability  function 

f{x\e)  =  a{x)l5{e)d^ ,  X  =  0, 1, 2, . . . ;  0  <  ^  <  Q  (1.1) 

where  a{x)  >  0  for  all  x  =  0,1,2,...,  and  Q  may  be  finite  or  infinite.  Consider  the 
problem  of  testing  Hq  :  d  Q.  [^1,^2]  versus  H\  :  d  ^  [$1,62],  where  0  <  <  ^2  <  00  are 
known  constants.  This  type  of  testing  hypotheses  may  arise  from  social  studies,  engineering 
problems  or  environmental  sciences.  For  example,  one  may  like  to  see  if  there  is  any  change 
of  the  frequency  of  rainfalls  during  the  last  several  years.  Let  i,  i  =  0, 1,  denote  an  action 
deciding  in  favor  of  the  hypothesis  Hi.  For  the  parameter  9  and  action  i,  the  loss  function 
is  defined  to  be: 

L{e,i)  =  {i-i){e-e^){e-92)i{9  ^  [^i,^2])  +  *(^-^i)(^2  -  W  e  [^1,^2]),  (1.2) 

where  I{A)  denotes  the  indicator  function  of  the  event  A. 

If  we  let  ^0  =  (^1  +  ^2)72,  c=  {02—  ^i)/2,  then  the  testing  hypotheses  can  be  written 
as  ifo  :  <  c  versus  H\  :  |^  —  I  >  and  the  loss  function  is 

L{9,i)  =  (1  -  0[(^  -  ^0)"  -  -  0o\  >c)  +  i[c'^  -{9-  9of]I{\9  -  ^o|  <  c).  (1.2') 
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Note  that  0  <  c  <  ^fl¬ 
it  is  assumed  that  the  parameter  ^  is  a  realization  of  a  random  variable  0  having  an 
unknown  prior  distribution  G  over  the  parameter  space  Q,  =  (0,  Q). 

Let  X  be  the  sample  space  generated  by  X.  A  test  <5  is  defined  to  be  a  mapping  from 
X  into  [0,1],  so  that  hix)  is  the  probability  of  taking  action  0  when  X  =  a:  is  observed. 
That  is,  S(x)  =  P{accept  ifo  |X  =  x}.  Then  for  each  x  =  0, 1, 2, . . . 

ms(x))  =  S(x)[(^  -  ffof  -  C^]  -  [(^  -  -  ^o|  <  C). 

We  consider  only  those  priors  G  such  that  f  d^dG{9)  <  oo  to  insure  that  the  Bayes 
risk  is  always  finite,  and  hence,  the  testing  problem  is  meaningful.  This  assumption  always 
holds  when  Q  is  finite. 

Let  r{G,  6)  denote  the  Bayes  risk  of  the  test  S.  By  Fubini’s  theorem,  we  have: 

OO 

r(G, ^  6{x)H{x)f(x)  +  C,  (1-3) 

x=Q 

where 

H(x)  —  (f(x  +  l)<y2’(a^)  —  2^oV’(®)  +  ^0  ~  ^^5  (1-4) 

(p(x)  =  P[0|X  =  x]  =  is  the  posterior  mean  of  0  given  X  =  x;  /(x)  =  f  f{x\d) 

dG{d)  =  a(x)  f  /3(9)d^  dG{9)  =  a{x)h{x)  is  the  marginal  probability  function  of  X,  and 

c  =  /[c2  -{9-  9of]I(\9  -  ^o|  <  c)dG{9). 
a 

From  (1.3),  a  Bayes  test,  say  Sci  is  clearly  given  by: 

f  1  if  H{x)  <  0, 

Sg{x)  =  j  (1.5) 

V  0  otherwise. 

The  minimum  Bayes  risk  is: 

OO 

r{G,  6o)  =  J2  Soix)H{x)f(x)  +  C.  (1.6) 

x=0 

When  the  prior  distribution  G  is  unknown,  this  testing  problem  has  been  studied  by 
Wei  (1991)  via  the  empirical  Bayes  approach.  Our  interest  is  motivated  by  the  result  of 
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Wei  (1991),  in  which  under  certain  strong  conditions,  Wei  (1991)  proved  that  his  proposed 
empirical  Bayes  test  may  achieve  a  rate  of  convergence  with  order  near  the  “best”  possible 
rate  where  n  is  the  number  of  historical  data  at  hand  for  the  present  testing 

problem.  Basically,  Wei’s  approach  is  along  the  line  of  Johns  and  Van  Ryzin  (1971). 
Though  this  rate  sounds  good,  the  conditions  can  be  reduced  and  the  rate  can  be  much 
improved. 

This  paper  is  organized  in  the  following  way.  In  Section  2,  we  first  examine  the 
behavior  of  the  Bayes  test  Sq,  and  then  construct  an  empirical  Bayes  test  that  6n  by 
mimicking  the  behavior  of  the  Bayes  test  So-  The  asymptotic  optimality  of  the  empirical 
Bayes  test  Sn  is  investigated  in  Section  3.  It  is  shown  that  under  very  mild  regularity 
conditions,  the  empirical  Bayes  test  Sn  is  asymptotically  optimal  of  order  0(exp  (— cn)) 
for  some  constant  c  >  0.  This  result  much  improves  that  of  Wei  (1991).  Finally,  certain 
examples  and  some  further  results  are  given  in  Section  4. 

2.  Construction  of  Empirical  Bayes  Test 
2.1  Properties  of  Bayes  test  So 

First  note  that  the  posterior  mean  <^(r)  =  is  increasing  in  x  for  x  =  0, 1, 2, . . .; 

and  is  strictly  increasing  if  the  prior  distribution  G  is  non-degenerate.  Let 

A  =  {x|93(x)  >  ^0  +  c},  and 


B  =  {x|9?(x)  <Bo  —  c}. 


Define 


inf  .4  if  A  7^ 
oo  if  A  =  <^; 


(  sup  B  'll  B  ^  <f> 

b*  =  (2.1) 

1-1  i£B  =  <t>] 

where  (j>  denotes  the  empty  set.  By  the  definition  of  a*  and  6*,  and  by  the  increasing 
property  of  (/?(x),  we  have:  b*  <  a*  and 

(p{x)  >  >  ^0  +  c  for  all  x  >  a* , 

(2,2) 

<f(y)  <<-p{b*)  <  9q  —  c  for  aU  y  ^  b*. 
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We  consider  only  non-degenerate  prior  distributions  G  so  that  ^p{x)  is  strictly  increasing 
in  X. 

Proposition  2.1 

(a)  For  X  >  a*,H{x)  >  0. 

(b)  For  X  <  b*,H{x)  >  0. 

Proof:  (a)  By  the  strictly  increasing  property  of  <p{x)  and  (2.2),  for  x  >  a*, 

H(x)  =  ip(x  +  'i.)<p{x)  —  26o<^{x)  +$1  — 

>  ip^{x)  —  29o^i^)  +  ^0  — 

=  (tf{x)  -6of  - 
>0. 

Part  (b)  can  be  obtained  in  a  similar  way.  The  detail  is  omitted. 

Let  D  =  {x|jEr(ar)  <  0}.  U  D  ^  define  d2  =  supJ?  and  di 
Proposition  2.1,  h*  <  di  <  d2  <  a* . 

Proposition  2.2  If  <^{x)  is  linear  in  x,  the  set  D  consists  of  all  integers  between  (including) 
di  and  d2. 

Proof:  Under  the  assumption,  ^{x)  =  ax +  b  for  some  constants  a  >  0  and  b.  Plugging 
this  linear  form  of  (f(x)  into  H{x),  we  obtain 

H(x)  =  x^  +  2x[a6  —  aOo  -f-  o^]  +  {b  —  $q)^  +  ab  —  (?, 

which  is  a  convex  function  of  x.  Therefore,  Proposition  2.2  is  concluded  by  noting  the 
definitions  of  di  and  d2 .  □ 

Proposition  2.2  well  describes  the  behavior  of  the  Bayes  test  Sg-  That  is,  as  soon  as 
d\  and  d2  are  determined,  then  the  Bayes  test  Sq  is  determined.  However,  without  the 
assumption  of  the  linearity  of  the  posterior  mean  (^(x),  it  is  not  knoAvn  whether  Proposition 


□ 

=  inf  D.  From 
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2.2  still  holds  or  not.  Even  though,  from  Proposition  2.1,  the  Bayes  test  So  can  be 
represented  as: 

0  if  (x  <  h*)  or  (x  >  a*) 

or  (b*  <  X  <  a*  and  H{x)  >  0);  ^2  3) 

1  if  6*  <  X  <  a*  and  H{x)  <  0. 

It  should  be  noted  that  Proposition  2.1  is  based  on  the  increasing  property  of  the 
posterior  mean  Hence,  in  the  following,  to  construct  an  empirical  Bayes  test,  we 

first  construct  a  monotone  empirical  Bayes  estimator  for  (p{x). 

2.2.  Empirical  Bayes  Framework  and  Estimation  of  ^(x) 

In  the  empirical  Bayes  approach,  let  (X,,  0i),i  =  1,2, . . .,  be  iid  with  (X,  0),  where 
Xi,i  =  1,2,...,  are  observable  and  €>i,i  =  1,2,...  are  not  observable.  At  time  n  +  1, 
X(n)  =  (Xi, . . .  ,X„)  denotes  the  historical  data  and  X„+i  denotes  the  present  random 
observation  and  one  is  interested  in  testing  Ho,n+i  :  |^n+i  —  ^o|  <  c  versus  Hi^n+i 

—  $o\  >  c  with  the  loss  L{dn+iii)  given  in  (1.2'),  where  ^n+i  is  a  realization  of  the 
random  parameter  0n+i.  A  test  Sn,  called  as  an  empirical  Bayes  test,  is  a  function  of  the 
present  observation  X„+i  =  x  and  the  historical  data  X(n),  such  that  5„(x,  X(n))  =  Sn(x) 
is  the  probability  of  accepting  the  hypothesis  JIo,n+i-  Let  r(G,  5„|X(n))  be  the  Bayes 
risk  of  the  empirical  Bayes  test  Sn  conditioning  on  X(n).  Also,  let  r{G,8n)  =  ^Xin) 
r(G,  5n|X(n))  denote  the  overall  Bayes  risk  of  Sn,  where  the  expectation  ^'_X’(ra)  taken 
with  respect  to  the  probability  measure  generated  by  X(n). 

Since  r{G,Sa)  is  the  minimum  Bayes  risk,  r{G,Sn)  >  r(G,5G)  for  all  n.  The  non¬ 
negative  regret  Bayes  risk  r{G,Sn)  —  r(G,  ^g)  is  used  as  a  measure  of  performance  of  the 
empirical  Bayes  test  Sn-  A  sequence  of  empirical  Bayes  tests  is  said  to  be  asymp¬ 

totically  optimal  relative  to  the  prior  distribution  G  if  r{G,  Sn)  —  r(G,  Sc)  =  o(l); 
is  said  to  be  asymptotically  optimal  relative  to  the  prior  distribution  G  of  order  {a!„}  if 
r{G,Sn)  —  r{G,SG)  =  0{an),  where  is  a  sequence  of  positive  numbers  such  that 

lim  On  =  0. 

n— ►oo 

Wei  (1991)  had  studied  an  empirical  Bayes  two-tail  test  for  this  testing  problem. 
Under  certain  strong  regularity  conditions,  Wei  (1991)  proved  that  his  proposed  empirical 
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Bayes  test  is  asymptotically  optimal  of  order  near  0(n  ^).  His  empirical  Bayes  test  is 
based  on  an  alternative  form  of  the  Bayes  test  that 

^g(x)  =  1  iff  7(0;)  =  h{x)H{x)  =  h{x  +  2)  —  2dQh{x  +  1)  +  h{x)[0Q  —  c^]  <  0. 


He  then  constructed  an  empirical  Bayes  estimator  'jn{x)  for  7(x),  and  his  empirical  Bayes 
test  6^  is  defined  as:  Sl^(x)  =  1  iff  7„(x)  <  0.  Though  is  asymptotically  optimal, 
such  an  approach  ignores  the  monotinicity  of  the  posterior  mean  <p(x).  In  the  following, 
we  first  construct  a  monotone  empirical  Bayes  estimator,  say  (fin(x),  for  <p(x).  Then  based 
on  (pn(x),  we  propose  an  empirical  Bayes  test  Sn  which  possesses  properties  similar  to  that 
of  Proposition  2.1. 

We  let  t>e  a  sequence  of  positive  numbers  such  that  the  following  condition 

holds. 

w(x) 
a(x+l) 

nonincreasing  in  x,  and  bounded  above  by  1. 

Based  on  the  historical  data,  let  rrin  =  min(Xi, . .  .,Xn)  and  Mn  = 
max  (Xi , . . . ,  Xn)  —  1.  For  each  a:  =  0, 1, . . .,  define 

{  fn{x)  =  i  E  (X,), 

^  (2.4) 

where  €„  >  0  is  such  that  e„  =  o(n“^).  For  each  y  =  0, 1, . . . ,  let 


Condition  Cl.  E  and  both  the  sequences  < 

x=o  I  ^ 


^n(y)  = 

i’  (y)  = 

Kn{y)  = 
K  (y)  = 


E  hnix  +  l)w{x), 

x—0 

E  h{x  +  l)t«(x), 

X=:0 

y 

E  hn{x)  w(x), 

x=0 

E  h(x)  w(x). 

z=0 


(2.5) 
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Also,  let  0„(— 1)  =  0(— 1)  =  Kn{—1)  =  JC(— 1)  =  0.  Next,  define 


^nimn) 


min 

TTln 


i’niy)  ' 
Kn{y). 


and  for  each  a;  =  +  1, . . . ,  M„,  recursively  define 


(2.6) 


<^n(x) 


=  min 
x<y<Mn 


'  i’njy)  -  ‘tknjx  -  1)  ' 

_Kn{y)  -Kn{x  -  1)J  ’ 


(2.7) 


where 

X 

M^)  =  ¥’n(*)  ^n(i)  w(i)  (2.8) 

i=0 

and  ip^(z)  =  <fn(i)  if  <  ar  and  (Pn(i)  =  for  *  <  ^n-  Finally,  for  0  <  a:  <  m^, 

define  <pn(x)  =  (pn(mn)  and  for  x  >  Mn  let  tfnix)  =  (pn{Mn)^ 


It  should  be  noted  that  {(,5„(x)}^„j^  is  the  isotonic  regression  of  {(/?„(x)}^„j^  with 
weights  {hn(x)w(x)}^^^^  where  (fn{x)  =  which  is  a  consistent  estimator  of  yp(x). 

Therefore,  <Pn(x)  is  also  a  consistent  estimator  of  <p(x),  see  BBBB  (1972).  We  state  the 
result  as  a  Lemma  without  providing  the  proof. 


Lemma  2.1  For  each  a;  =  0, 1, ... ,  <fn(x)  converges  to  (p{x)  in  probability. 

2.3  Empirical  Bayes  Test 

By  mimicking  the  form  of  (1.4)  -  (1-5),  an  empirical  Bayes  test  Sn  is  constructed  as 
follows:  For  each  Xn+i  =  x,  let 

Hn{x)  =  If  nix  +  l)fnix)  -  29ofnix)  +  (2-9) 


and 


1  if  Hnix)  <  0, 


Snix)  = 

I 

0  otherwise. 
Given  Xin),  the  conditional  Bayes  risk  of  6n  is 


(2.10) 


r(G,«„|X(n))  =  ^  i„(i)if(x)/(i)  +  C, 


(2.11) 


a;=0 


I 
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and  the  overall  Bayes  risk  of  Sn  is 


=  £  %(»)  [in(x)lir(x)/(x)  +  C.  (2.12) 

x=0 

For  each  n,  let  An  =  +  c}  aiid  Bn  =  “  c}-  Define 


an  = 


hn  — 


J  inf 

if  An  7^  <!>, 

oo 

if  An  =  (p] 

supB„ 

if  Bn  i=-  (p. 

-1 

if  Bn  =  p. 

(2.13) 


Note  that  <Pn{x)  is  nondecreasing  in  x.  Therefore,  by  the  definitions  of  On  and  bn  <  an, 
and 

’  <Pni.x)  >  (fnian)  >  do  +  c  for  all  X  >  an, 

<  ,  ,  (2-14) 

,  <fn{y)  <  <pn(bn)  <  Oq  -  c  for  all  y  <  bn. 

By  the  nondecreasing  property  of  <pni^)  and  (2.14),  similar  to  Proposition  (2.1),  Hn{x)  >  0 
for  all  X  >  On  and  for  all  x  <  bn-  Hence,  the  empirical  Bayes  test  Sn  can  be  represented 
as: 


6n{x) 


0  if  (x  <  bn)  or  (r  >  a„) 

or  (bn  <  X  <  On  and  Hn{x)  >  0), 

1  if  6„  <  X  <  a„  and  Hn(x)  <  0 


(2.15) 


which  is  similar  to  that  of  (2.3). 


Remark  2.1 


(a)  Since  {(^„(x)}^„.,^  is  the  isotonic  regression  of  {<fn(x)}^^^  with  weights 
{hn(x)w{x)}^^jj^^  ,  by  BBBB  (1972)  and  by  the  definitions  of  i>niz)  and  ipniz), 
^n{z)  <  i’niz)  for  all  2  =  0, 1, ... ,  Mn-  Therefore,  for  each  x  =  m„, . . . ,  M„, 


^n(^x) 


min 

x<y<Mn 


'  i’njy)  -  i’njx  -  1)  ' 

Kn{y)-Kn{x  -  1). 


>  min 
x<y<Mn 


V’n(y)  -fbnjx  -  1)  ' 

Kn{y)-Kn{x-1)/ 


(2.16) 
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(b)  Following  Puri  and  Singh  (1990),  the  isotonic  regression  estimators  can 


also  be  derived  in  an  alternative  way. 
Define 

ipn{Mn)  -  max 

mn<y<Mn 


'  ^n{Mn)  -  ^n{y  "  1) 

Kr,{Mn)-Kn{y-l)y 

and  for  each  x  =  Mn  —  1, . . . ,  recursively  define 


=  max 


Mn  ~ 

JV’n(M„)-V»„(j/-l)]  -  £  y}n{i)K{i)w{i) 

i=x+l 

K„(x)  -  K„(y  -  1) 


(2.17) 


(2.18) 


Then,  =  >fn{x)  for  all  a:  =  rrin,  •  • . ,  Mn-  Also, 


Mn 


Mn 


^2  ‘Pn{i)hnii)w{i)  >  ^2  hn(i  +  l)w{i)  =  'll:>n{Mn)  -i/’nix)-  (2.19) 


i=x+l 


i=a:4-l 


Combining  (2.18)  and  (2.19)  yields 


<  max 

T^n<y<X 


IMMn)  -  My  - 1)]  -  iMMn)  -  M^)] 
Kn{x)-Kn(y-1) 

^nix)  -  ll’niy  -  1) 


mn<y<x  [ A'’„(x)  —  jK’„(y  —  1)J 


(2.20) 


3.  The  Main  Results 

We  state  our  main  results  of  the  paper  as  two  theorems  as  follows. 

Theorem  3.1  Suppose  f  9^  dG(9)  <  oo  and  Condition  Cl  holds.  Then,  the  empirical 
Bayes  test  Sn  is  asymptotically  optimal  in  the  sense  that  r(G,Sn)  —  r(G,  ^g)  =  o(l). 

Theorem  3.2  Suppose  that  f  9^  dG{9)  <  oo,  Condition  Cl  holds  and  a*  is  finite.  Then 
r(G,Sn)  —  r(G, 6g)  =  0(exp  (— rn))  for  some  positive  constant  r  =  t(G)  depending  on 
the  prior  distribution  G. 

We  provide  the  proof  of  Theorem  3.1  as  follows. 
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Proof  of  Theorem  3.1 


Let  Si  =  {x\b*  +  1  <  X  <  a*  —  1,  H(x)  <  0}  and  S2  =  {x\b*  + 1  <  a;  <  a*  —  1,  H{x)  > 
0}..From  (1.5),  (1.6),  (2.10),  (2.11)  and  by  the  definition  of  a*  and  b*, 


6* 

r{G,S„)  -  r{GJa)  =  Y,  <  f.  -ffW  >  0} 

x=0 


+  ^  [-F(x)]  fix)  P{Hnix)  >  0,  Hix)  <  0} 

X  e  Si 


+  P{Hnix)  <  0,  Hix)  >  0} 

X  £  S2 


(3.1) 


00 

+  PWx)  <  0,  Hix)  >  0} 

a;=a*H-l 


00 

<  Y  i^wi/(^). 

a:=0 


d 

where  =  0  if  d  <  c  and 

X=C 


E  =0. 


Since 


|jy(x)|  =  \E[Q^\X  =  x]  -  2do  E[e\x  =  x]  +  el-c^ 


<E[e^\x  =  x]  +  2doE[e\x  =  x]  +  \0l-c'^\, 

Y  /(*)  =  Ex(|ir(x)|] 

(3.2) 

<  Ex[E[e^\X]]+  200  Ex  [i^[0m]  +  \0l  -  c^\ 

=  E[e^]  +  2doi;[0]  +  \0l-c‘^\ 


<  00 

by  the  assumption  that  f  0“^  dGi0)  <  00. 


11 


Hence,  to  show  that  r{G,6n)  -  r{G,6G)  =  o(l),  it  suffices  to  prove  that  for  each  x 
with  H{x)  >  0,  P{Hn{x)  <  0,  fr(x)  >  0}  — »■  0  as  n  oo,  and  for  each  x  with  H{x)  <  0, 
P{Hn{x)  >  0,  H{x)  <  0}  — »•  0  as  n  — ^  oo. 

Since  Hn{x)  =  (^„(x  +  1)  (pn{x)  -  26o  <^n(x)  +  0^  -  c^,  where  (pn{x)  -+  <p{x), 
(^„(x  +  !)—*■  if(x  +  1)  in  probability  by  Lemma  2.1,  so,  Hn(x)  H{x)  in  probability. 
Hence,  both  P{Hn{x)  >  0,  H{x)  <  0}  and  P{Hn{x)  <  0,  H(x)  >  0}  converge  to  0  as 
n  ^  oo.  Therefore  the  proof  is  complete.  □ 

3.1  Preliminary  Analysis 

For  providing  a  precise  proof  for  Theorem  3.2,  we  first  do  certain  preliminary  analysis. 
When  b*  =  —1,  in  (3.1),  the  term  S(x)  f{x)  P{Hn{x)  <  0,  H(x)  >  0}  is  equal  to  0. 

x=0 

Hence,  in  the  following,  we  may  assume  that  b*  >  0. 

Define  the  following  events: 

El  =  (bn  =  6*,  a„  =  a*}, 

Ai  =  {bn<b*-l  or  bn>b*  +  1}, 


■d.2  ={bn  —  6*  +  1}, 


Pi  =  {Sn  <  a*  —  1  or  On  >  a*  +  1}, 


B2  =  {On  =  a*  +  1}, 

E2  =  {rUn  <  b*  and  M„  >  a*  +  2}. 

Then,  =  U  U  (A,-  Bj)  and  >  b*  or  Mn  <  a*  +  2}. 

2=1  j=l 

Conditioning  on  .X’(n),  the  regret  Bayes  risk  of  is: 

r{G,6n\X(n))-r{G,6G) 

00 

=  X!  H{x)[6n(x)  -  Sg{x)]Ie^ 

x=0 
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+  ^  /(®)  •^(^)  [^n{^)  -  ^G{x)]lExEi 
a;=0 

(3.3) 

oo  2  2 

+  Y1  [^n(a^)  -  ^g((c)]  ^  ^  lAiBjE^- 

X  =  0  2=1  j=l 

By  the  definitions  of  the  events  Ei  and  A2B2  and  the  tests  8n  and  6g, 

OO 

f{x)  H{x)  [Sn(x)  -^0(3^)]  IEiE:i 

x=0 

(3.4) 

a*-l 

—  X]  fix)  H{x)  [6n{x)  —  Sg{x)]  IeiE2‘, 

x=6’^+l 


00 

y^/(x)  J3'(x)  [^„(x)  -  5G(aj)]-rA2B2£(2 

x=0 

(3.6) 

a* 

=  X^  /(®)  ■^(^)  [^n(a;)  -  ^gC^:)]  Ia^b^e^- 

x=6*+l 

Therefore,  the  overall  Bayes  risk  of  the  test  8n  is: 
r{G,8n)-riG,8G) 

=  ^X(n)  [r{GX\Un))-riG,8G)] 

OO 

x=0 

a*-\ 

+  XI  /(^)  -^X(n)P«(®)  “<^G((c))i'£:i£2] 

x=6*+l 

o* 

+  X^  fi^)  ^i^)  ^X{n)[i^’^i^)  ~  ^Gi^)yMB2E2] 

r=6*+l 
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+  S  ~  ^g{x))(IaiBiE2  +  IA1B2E2  +  Ia2BiE2)]- 


x—0 


We  can  obtain  the  following  results: 


(a) 


^  /(x)  H(x)  Ex(^n)ii^nix)  -  Soix))  Iec] 


a;=0 


=  %(«),X)  -  So{X))  /bsI 

=  Ex  [|ir(Jf)ll%(„)fos! 

since  X  and  X{n)  are  independent. 

From  (3.2),  FJx[i-ff(-X‘)|]  <  00.  By  the  definitions  of  rrin  and  M„, 
EX(n)\.^Et^  ~  E{'’^n  >  b*  or  Mn  <  o*  +  2} 


(3.6) 


<  P{m„  >  6*}  +  P{Mn  <a*  +  2} 


=  [P(6*)]"  +  [P(a*+2)]” 

=  exp[— n  in(F(6*))“^]  +  exp[— n  in{F{a*  +  2))“^] 


=  0(exp(-rin)), 

where  F  is  the  marginal  distribution  function  of  the  random  variable  X,  F{x)  =  1  —  F{x) 
and  Ti  =  min{^n{F{h*))~^ ,in{F{a*  +  2))~^)  >  0.  Therefore, 

OO 

Y,  Six)  H(x)Ex^„pn(x)  -  fc(x))/E.I  =  0(exp(-rir.)).  (3.7) 

x=0 
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(3.8) 


(b) 

a*-l 

^  fix)  ff(x) 

I=6*+1 

=  [~H{x)]f{x)P{6n{x)  =  0,<5g(x)  =  1  and  E1E2  occurs} 

I  €  Si 

+  ^  f{^)P{^nix)  =  1,  Saix)  =  0  and  E1E2  occurs}. 

X  E  S2 

(c) 

a* 

Y,  /(x)%(„,[(«„(x)  -  Sa(x))lA,B,E,] 

x=6*+l 


=  ^  [— fi’(x)]  f(x)P{6n(x)  =  0,^g(x)  =  1  and  A2B2E2  occurs} 

^  (3.9) 

+  ^  P{^n(x)  =  1,Sg{x)  =  0,  and  A2B2E2  occurs} 

X  e  Si 

+  H{a*)  f(a*)P{Sn{a*)  =  l^Saia*)  =  0  and  A2B2E2  occurs}. 

(d) 

00 

E  S{x)  ~  ^g{x)){IaiBiE2  +  IaiB2E2  +  lA2BtE2)] 

x=0 

-  (3.10) 

=  Ex\\HiX)\\{Ex^„y[lA,EA  +  £x(„,[/b.£,1}. 


In  (3.8)  -  (3.10),  0  <  Y.  [-ir(l)l/(l)  <  £x[|ir(ir)ll  <  00,  0  <  £  H(x)f(x)< 

X  €  Si  X  6  S2 

£'x[|i^(.X’)|]  <  00.  Note  that  under  the  assumption  that  a*  is  finite,  both  5i  and  S2 
are  finite  sets.  Therefore,  to  investigate  the  asymptotic  behavior  of  the  regret  Bayes  risk 


15 


r(G,  5n)  —  ’'(G,  it  suffices  to  investigate  the  asymptotic  behaviors  of  the  following 
terms: 

Di  =  P{^„(a:)  =  0,Sg(x)  =  1  and  E1F2  occurs  }  for  a:  €  Sj, 

D2  =  P{6n{x)  =  l,6G(a:)  =  0,  and  E1E2  occurs  }  for  a:  €  S2, 

Dz  =  P{6n{x)  =  0,6g{x)  =  1,  and  A2B2E2  occurs  }  for  x  €  Si, 

D4,  =  P{Sn{x)  =  1,Sg(x)  =  0  and  A2B2E2  occurs  }  for  x  €  S2, 

D5  =  P{Sn{a*)  =  1,5g(<2*)  =  0  and  A2B2E2  occurs  } 

De  =  Exf^^^[lA^E2]  and  D7  = 

(I)  By  the  definitions  of  the  tests  Sn  and  Sg,  for  x  E  Si, 

Di  =  P{5„(x)  =  0,  ^G(a^)  =  1  and  E1E2  occurs.} 

=  P{Hnix)  —  H{x)  >  —H(x)  and  E1E2  occurs  } 

=  P{[^nix  +  1)  -  (p{x  +  l)]9n(x)  +  [(p(x  +  1)  “  2^o][<^n(a:)  -  V5(x)]  >  -H{x) 
and  E1E2  occurs  } 

<  P{[ipn{x  +  1)  —  (fix  +  \)](pn{.x)  > - and  E1E2  occurs  } 

jET  ( xl 

+  P{{if{x  +  1)  —  20o][<^n(a:)  —  9(®)]  > - ^  and  E1E2  occurs  } 

=  -1^11  +  Di2. 

On  Pi,  for  X  E  Si,  0  <  Oq  —  c  <  <fin{x)  <  9o  +  c  <  20q.  So 

Pii  <  P{<pnix  +  1)  -  9?(x  +  1)  >  and  E1E2  occurs}. 

4tro 

Also,  for  X  €  5i,  if  x+1  <  a*,  then  by  the  definition  of  a*,  do—c  <  (f{x+l)  <  9o  +c  <  29o. 
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Hence, 


JE[  (x) 

Di2  =  P{<fn{x)  -  ^{x)  <  2(2^0  -  y(x  +  1)]  ^ 

H  (x) 

<  P{(fn{x)  —  (p{x)  <  --— —  and  E1E2  occurs  }. 

Wq 

When  x  +  1  =  a*,  there  axe  three  cases:  y^(ct*)  <  26o  or  <p{a*)  =  'Ido  or  (p{o,*)  >  2do- 
Hence, 

Dn  =  -^{[^^(0*)  -  2^o][<^n(a:)  -  ^{x)]  >  an<i  E1E2  occurs  } 

'  P{(pn(x)  —  ip{x)  <  and  E1E2  occurs  }  if  <p{a*)  <  2^o, 

<  i  0  if9(a*)  =  20o, 

^  P{(pn{x)  -  <f{x)  >  and  E1E2  occurs  }  if  ip{a*)  >  20o. 

(II)  For  X  €  52, 

D2  =  P{6n{x)  =  1,Sg{x)  =  0  and  E1E2  occurs  } 

=  P{Hn{x)  —  H(x)  <  —H{x)  and  E1E2  occurs  } 

=  P{[9„(x  +  1)  -  (fi{x  +  l)](,5n(x)  +  [v?(x  +  1)  -  26Q\[^n{x)  -  <p{x)]  <  -H{x) 
and  E1E2  occurs  } 

H  f 

<P{[(,5„(x  +  1)  —  ^{x  +  l)](^n(x)  < - ^  and  E1E2  occurs  } 

H  f  x^ 

+  P{[p{x  +  1)  —  2^o][<^n(a:)  —  ¥'(a;)]  < - ^ —  and  E1E2  occiurs  } 

=  D21  +  -D22? 

where  by  an  argument  analogous  to  that  for  D\ , 

-D21  <  P{'^n{x  +  1)  -  <-p{x  +  1)  <  -  \  -  and  P1P2  occurs  }, 
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and 


H  f  x) 

D22  =  +  1)  -  -  c/?(x)]  < - and  E1E2  occurs} 

'  P{(pnix)  —  ‘fix)  >  and  E1E2  occurs}  if  (p{x  4- 1)  <  29o, 

<  ^  0  if  (fix  +  1)  =  26o 

,  Pi^Pnix)  -  p{x)  <  —  2y f|.~)  and  E1E2  occurs}  when  x  +  1  =  a*  and  p{a*)  >  20o 

(III)  Similaxly,  on  A2B2E2,  for  x  €  -Si,  0  <  Pn{^)  <  9q  -\r  c  <  2^o,  and 
Dz  =  P{6n{x)  =  0,^G(a;)  =  1  and  A2B2E2  occurs} 

<  P{(^„(x  +  1)  —  p{x  +  1)  >  — and  A2B2E2  occurs} 

4t/o 

'  P{(fnix)  —  p{x)  <  and  A2B2E2  occurs}  if  (^(x  +  1)  <  2^o 
+  ^  0  if  p{x  +  1)  =  2^0, 

^  P{(^„(x)  —  (/5(x)  >  and  A2B2E2  occurs}  when  x  +  1  =  a*  and  p{a*)  >  20o 


(IV)  On  A2B2E2,  for  X  €  S2,  0  <  Pn(x)  <  ^0  +  c  <  29o, 
£>4  =  P{^„(x)  =  1,^g(x)  =  0  and  A2B2E2  occurs} 


<  P{9„(x  +  1)  —  p{x  +  1)  <  — and  A2B2E2  occurs} 

4^0 


'  P{(^„(x)  —  9?(x)  >  and  A2B2E2  occurs}  if  <p{x  +  1)  <  29o, 

+  ^  0  if  p(x  +  1)  =  29o, 

^  P{ifn{x)  -  9?(x)  <  -  2y(ai)  >  and  A2B2E2  occurs  }  if  x  +  1  =  a*  and  p{a*)  >  29o 
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(V) 


Ds  =  P{Sn{(i*)  =  =  0  and  A2B2E2  occurs  } 


<  P +  1)  —  ^{o,*  +  1)  < 


E£1 

4^0 


and  A2B2E2  occurs  } 


P{(^n(a*)  —  and  A2B2E2  occurs  }  if  (p{a*  +  1)  <  26o, 

+  .j  0  if9?(a*  +  l)  =  20o, 

^  P{(^„(a*)  -  (p{a*)  <  - 2^i*+i)  and  A2B2E2  occurs  }  if  (fi(a*  +  1)  >  20o. 


(VI) 

De  = 

=  P{(bn  <  b*  —  1  or  bn  >  b*  +  1)  and  E2  occurs  } 

=  P{bn  <  b*  —  1  and  E2  occurs  } 

+  P{bn  >  6*  +  1  and  E2  occurs  } 

=  P{ipn{b*)  >  Oq  —  c  and  E2  occurs  } 

+  +2)  <  60  —  c  and  E2  occurs  } 

=  P{(fin{b*)  —  <(3(6*)  >  (^0  ~  c)  —  <p{b*)  and  E2  occurs  } 

+  P{(^„(6*  +  2)  —  9?(6*  A  2)  <  Oq  —  c  —  (p{b*  +  2)  and  E2  occurs  }. 

Here,  note  that,  by  the  definition  of  6*,  (^0  ~E)—<f{b*)  >  0.  Also,  since  the  prior  distribution 
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G  is  non- degenerate,  by  the  definition  of  b*  again,  (^o  —  c)  —  (p{b*  -H  2)  <  0. 

(VII)  Dr  = 

=  P{(an  <  a*  —  1  or  On  >  a*  +  1)  and  E2  occurs  } 

=  P{a„  <  a*  —  1  and  E2  occurs  } 

-I-  P{a„  >  a*  -f  1  and  E2  occurs  } 

=  P{(fn((i*  —  l)>0o  +  c  and  E2  occurs  } 

-t-  P{(^„(a*  -f  1)  <  ^0  +  c  and  E2  occurs  } 

=  P{(^„(a*  —  1)  —  <p{a*  -  1)  >  {Oq  +c)  —  (p{a*  —  1)  and  E2  occurs  } 

-1-  P{(^„(a*  +  1)  —  +  1)  <  (^0  +  c)  —  -I-  1)  and  E2  occurs  }. 

Note  that,  here,  (^0  +  c)  —  (p(a*  —  1)  >  0  while  (^0  +  c)  —  <^(a*  -I-  1)  <  0. 

Based  on  the  above  analysis  for  £>1  through  P7 ,  to  study  the  asymptotic  behavior  of 
the  regret  Bayes  risk  r'(G,  S„)  —  r{G,  Sq),  it  suffices  to  investigate  the  asymptotic  behavior 
of  the  following:  Ai„(x)  =  P{(pnix)  —  >  d(x)  and  E2  occurs  }  for  b*  <  x  <  a* , 

and  A2n{^)  =  P{‘Pn(x)  —  <f(x)  <  —d(x)  and  E2  occurs  }  for  6*  1  <  x  <  a*  4- 1,  where 
c^(x)  >  d(x)  >  0,b*  <  x  <  a*  +  1,  d{x)  is  a  suitably  defined  positive  function  and  its 
definition  is  imphcitly  contained  in  the  form  of  upper  bounds  oi  Di,i  =  1...7,  given 
previously. 

3.2  Lemmas 

In  this  subsection,  we  introduce  certain  lemmas  which  are  helpful  to  investigate  the 
asymptotic  behaviors  of  Ai„(x)  and  A2n{x)- 

The  following  lemma  is  from  Liang  (1991). 

Lemma  3.1  Let  be  a  sequence  of  real  numbers  and  be  a  sequence  of 


20 


nonincreasing  positive  numbers  with  6i  <  1.  Then,  for  any  positive  constant  d, 

n  n 

sup  I  at  bt\  >  {>)d  =>  sup  |  at\  >  {>)d. 


n>l  t=l 


n>l  t^^ 


Let  Fn  be  the  empirical  distribution  based  on  X{n)  =  {Xi, . . .  ,Xn)  and  F  the 
marginal  distribution  function  of  the  random  variable  X. 

Corollary  3.1  Let  d  be  a  fixed  positive  value  and  ^  be  a  fixed  nonnegative  integer.  Then 
under  Condition  Cl,  for  n  being  sufficiently  large,  the  following  holds. 

(a)  sup  \[KM  -  K{y)]  -  [Kn{i  -  1)  -  K{i  -  1)]|  >  (>)d 

y>t 

=>  sup  \Fn(y)  -  F{y)\  >  (>)f . 

j^>0 

(b)  sup  |[^n(y)  -  ^(y)]  -  bl’nii  -  1)  -  V’(^  -  1)]|  >  {>)d 

y>t 

^  snp  \Fn{y)  -  F{y)\  >  (>)  |. 

y>0 

Proof:  Since  =  o(n~^),  under  Condition  Cl,  there  exists  an  integer  N  =  N(d)  such 

OO 

that  for  n  >  iV,  €n  ^  w(x)  <  |. 


x=0 

Next,  note  that 


Xniy)  = 


x=0 


=  E 


x=0 


x=0 


Kiy)  =  E  /(^)  ^ 


x=0 


w(x) 

(x)' 


Hence,  for  n  being  large  enough  such  that  e„  <  §, 


x=0 


sup  \[Kn{y)  -  K{y)]  -  [Kn(£  -  1)  -  Kii  -  1)]1  >  {>)d 

y>e 


=»  sup 

y>t 


ifnix)  -  X] 
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sup  I  [fn{x)  -  /(a;)]^^  I  >  (>)^  d 
y>t  ^  a[x)  3 

y  2 

sup  I  [fnix)  —  /(a;)]|  >  (>)^d,  by  Lemma  3.1  under  Condition  Cl, 
yi‘  3 

^  sup  |(f„(y)  -  F{y)]  -  \F„(l  -  1)  -  F(l  -  1)||  >  (>)?rf 

y>t  3 

sup  \Fniy)  -  F{y)\  >  (>) 

j,>0  3 

Part  (b)  can  be  proved  in  a  similar  way.  □ 

Define  di{x)  =  </?(x)  +  d(x),  d2(x)  =  <^(x)  —  d{x).  Note  that  di{x)  >  0,  i  =  1,2.  For 
each  y  >  X,  define. 


y  y 

Qxiy)  =  d2{x)  E  h(t)w{t)  —  h{t  +  l)w{i). 

t=x 


Also,  for  each  z  <  define 


X  X 

Px{z)  =  -  E  h(t  +  +  di{x)  y~^  h{t)w{t). 

t=Z  t=Z 


Lemma  3.2  (a)  qx{y)  is  decreasing  in  y  for  y  >  x.  Hence, 

max  qx{y)  =  qx{x)  =  h{x)w{x)[d2{x)  —  (p{x)\ 

y>x 

=  h{x)w(x)(—d(x))  <  0. 
(b)  Pxiz)  is  decreasing  in  2  for  z  <  x.  Hence, 

min  px(z)  =  px(x)  =  iy(x)/i(x)[c?i(x)  —  9?(x)] 

0<z<a: 

=  w(x)h(x)d(x)  >  0. 
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Proof:  (a)  For  y  >  x,  consider 

?x(y  +  1)  -  9r(y)  =  d2{x)h{y  +  l)w{y  +  1)  -  h(y  +  2)w{y  +  1) 

=  h{y  +  l)w{y  +  l)[d2{x)  - 
=  h{y  +  l)w{y  +  l)[v?(a:)  -  d{x)  -  <f{y  +  1)] 

<0 

since  (p{x)  —  ip{y  +  l)  <  0  for  y  >  x  and  d{x)  >  0.  Hence,  qx{y)  is  decreasing  in  y  for  y  >  x. 

(b)  For  z  <  X,  Consider 

Pxiz)  —  Px{z  -  1)  =  h(z)w(z  -  1)  -  di(x)h(z  -  l)w(z  —  1) 

=  h{z-l)w{z-l)  -  di{x) 

=  h{z  —  \)w{z  —  'i)[^{z  —  1)  —  ¥^(x)  —  d(x)] 

<0 

since  ^p{z  —  1)  —  <j?(x)  <  0  for  0  <  x  <  x  and  d{x)  >  0.  So,  Px{z)  is  decreasing  in  z  for 

0  <  z  <  X.  □ 

Let  A^„(x)  =  ?/’„(x)  -  '0(x),  Ak-„ (x)  =  A'„(x)  -  K{x)  and  Af„(x)  =  F„(x)  -  F{x). 

Lemma  3.3  (a)  For  each  b*  <x  <  a*,  and  n  being  sufficiently  large, 

{  <Pn{x)  —  (,£?(x)  >  d(x)  and  E2  occurs} 

C  {  .up  |Af.(!,)|  > 

(b)  For  each  6*  +  1  <  x  <  a*  +  1,  and  n  being  sufficiently  large, 

{  ipn(x)  —  <p{x)  <  —d{x)  and  E2  occurs} 
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Proof:  (a)  For  6*  <  x  <  a*,  by  (2.20)  and  Corollary  3.1,  for  n  being  sufficiently  large, 
{(pn{x)  —  (^(x)  >  d{x)  and  E2  occurs} 

=  {(pn{x)  >  (^(x)  +  d{x)  =  di(x)  and  E2  occurs} 

c  {[ipnix)  -i^niy  -  1)]  -  [A'„(x)  -  Kniy  -  l)]di(x)  >  0 
for  some  x  >y  >  m„  and  E2  occurs} 

C  U  {[A^„(x)  -  A^„(y  -  1)]  -  di{x)[AK„{x)  -  AkSv  “  1)]  >  My)] 

y=Q 

C  U  {[A^„(x)  -  A^„(y  -  1)]  -  di(x)[Ai^„(x)  -  AK„(y  -  1)]  >  p^ix)} 

y=:0 

c  {[Av,„(a:)  -  A^„(y  -  1)]  >  or  [Ai^„(x)  -  Air„(y  -  1)]  < 

C  {  SJ  |A,.,(!/)|  >  ^  or  sup  I  Ap.Wl  > 

=  {sup  |Af..(y)|>?^mm(l.^)}. 

(b)  For  each  6*  +  1  <  a:  <  a*  +  1,  by  (2.16)  and  Corollary  3.1,  for  n  being  large  enough, 
{(pn{x)  —  <^(x)  <  —d{x)  and  E2  occurs} 

=  {(pn  <  <p{x)  —  d(x)  =  d2{x)  and  E2  occurs} 

C  {[V’n(y)  -  V’n(a;  -  1)]  -  d2(x)[A„(y)  -  Kn{x  -  1)]  <  0 
for  some  x  <y  <  Mn  and  E2  occurs} 

=  {[A^„(y)  —  A^^(x  —  1)]  —  d2{x)[AK^(y)  —  Aj^nix  —  1)]  <  yx{y) 

for  some  x  <  y  <  M„  and  E2  occurs} 

C  {[A^niy)  -  Av-„(a:  -  1)]  -  d2(a:)[Ai^„(y)  -  A;^„(x  -  1)]  <  qx{x)  for  some  x  <  y} 
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c  {A^„(y)  -  A^„(x  -  1)  <  or  [AkM  “  A;^„(x  -  1)]  >  for  some  x  <  y} 


C  {sup|Av,„(y)- A^„(x-l)|  >  or  sup  |AA'„(y)  -  A/^Jx  -  1)|  > 

C  {sup|AF„(y)|  >  or  sup|AF„(y)|  > 

J,>0  6  y>Q  od2{x) 


=  {sup|AF„(y)i  > 

J,>0  D  a2{X) 

3.3  Proof  of  Theorem  3.2 


Px(x) 


Let  To  =  min  ~ 

6*<x<o*  ° 

that  both  T2  and  T3  are  positive.  Hence  r  =  min(ri,  r2,  Ts)  >  0. 


min 

6*+l<i<o*+l 


6 


Note 


From  Lemma  3.3,  for  each  b*  <  x  <  a*, 

P{(pn{x)  —  (p(x)  >  d{x)  and  E2  occurs} 


<  P{sup  |Af.(!,)|  > 

<  P{sup|AF„(y)|  >  ra} 


(3.11) 


<  d  exp(— 2nr|), 

by  the  exponential  type  inequality  of  Dvoretzky,  Kiefer  and  Wolfowitz  (1956),  where  d  is 
a  positive  constant  independent  of  the  distribution  function  F. 

Also,  for  6*  +  1  <  X  <  a*  +  1,  from  Lemma  3.3, 

P{<fnix)  —  (p{x)  <  —d{x)  and  E2  occurs} 


<  P{sup  I  AF„(y)|  >  min  (l,  j^) } 

j,>0  D  <l2\X) 

<  P{sup|AF„(y)l  >  rs} 

y>Q 

<  d  exp(— 2nr|). 


(3.12) 
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Now,  combining  the  results  of  Section  3.1,  (3.7),  (3.11)  and  (3.12),  we  conclude  that 
r{G,6n) -r{G,8G)  =  0(  exp{-Tn)).  □ 


4.  Example,  Remarks  and  Further  Results 
4.1  Examples 

We  use  the  following  two  examples  to  illustrate  the  choice  of  the  positive  numbers 
{^(®)}x^o  demonstrate  the  asymptotic  optimality  of  the  empirical  Bayes  two-tail  test 

^n. 

Example  1.  (The  Poisson  distribution).  Suppose  that 

f{x\d)  =  e~^d^ lx\^  X  =  0,  1,  2,  . . . ;  and  0  <  ^  <  oo. 

Then,  a{x)  =  Thus  we  let  tf;(x)  =  a{x-\-t)  =  where  £  is  a  fixed,  positive  integer. 

Then,  both  and  are  nonincreasing  in  x,  bounded  above  by  1  and 

OO 

^  u;(x)  <  OO.  Hence  the  requirements  of  Condition  Cl  axe  met. 

Assiune  that  the  prior  distribution  G  is  a  member  of  the  family  of  gamma  distribution 
with  density  function  g(0jk,jd)  of  the  form 

g(0lk,j3)  =  e“^^,  0  <  ^  <  co,  k>0,^>0. 

r{k) 

Then,  (p(x)  =  which  tends  to  oo  as  x  oo.  Therefore,  for  finite  0  <  c  <  <  oo. 

Then,  by  Theorem  3.2,  we  have  r(G,Sn)  —  r(G,SG)  =  0(exp(— rn))  for  some  r  >  0. 

Example  2  (The  Negative  binomial  distribution).  Suppose  that 
/(x|«)=  (^+^“l)«*(l -«)-■,  X  =  0.1,  2, 

where  r  is  a  fixed,  positive  integer.  Then  a(x)  =  (""^17^).  We  let  w(x)  =  so  that 

nonincreasing  in  x  and  bounded  above  by  1.  Also  ^  w(x)  <  oo. 

X  ~  0 

Hence,  the  requirements  of  Condition  Cl  are  met. 

Suppose  that  the  prior  distribution  G  is  a  member  of  the  family  of  beta  distribution 
with  parameter  (a,^).  Then,  <p(x)  =  which  tends  to  1  as  x  oo.  Thus  for 
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0  <  c  <  ^0  <  1  such  that  +  c  <  1,  a*  <  oo.  Therefore,  by  Theorem  3.2,  r(G,S„)  — 
r(G,So)  =  0(exp(—Tn))  for  some  r  >  0. 

Wei  (1991)  considered  several  situations  about  the  behavior  of  the  tail  probability  of 
the  prior  distribution  G  under  which  his  proposed  empirical  Bayes  test  may  achieve 
a  rate  near  the  best  possible  rate  of  convergence  of  order  0(n~^).  We  may  also  apply 
those  conditions  to  the  empirical  Bayes  test  For  example,  under  the  assumption  of 
Theorem  4.2  of  Wei  (1991),  one  can  see  that  <p(x)  — »■  oo  as  x  — >  oo.  Thus  H(x)  >  0  for 
X  being  sufl&ciently  large  and  a*  <  oo.  Therefore  r(G,Sn)  —  r{G,Sc)  =  0(exp(— rn))  for 
some  r  >  0.  We  see  that  under  the  same  conditions,  6n  has  a  rate  of  convergence  much 
faster  than  that  of  .  Basically,  Wei’s  approach  is  along  the  line  of  Johns  and  Van  Ryzin 
(1971),  in  which  one  needs  to  treat  the  asymptotic  behavior  of  each  term  in  an  infinite 
series  of  the  regret  Bayes  risk.  Our  approach  is  somewhat  different  from  Wei’s.  We  mimick 
the  behavior  of  the  tmknown  Bayes  two  tail  test  8g-,  so  that  one  only  needs  to  deal  with  the 
asymptotic  behavior  of  finite  terms  of  probabilities,  which  have  been  discussed  in  details 
in  Section  3.1. 

If  it  is  not  possible  or  hard  to  find  a  sequence  of  positive  numbers  {i«(x)}^o  satisfy 
the  requirements  of  Condition  Cl,  we  may  consider  the  following  alternative  condition. 

oo 

Condition  C2.  {iy(x)}^o  is  a  sequence  of  positive  numbers  such  that  ^  <  oo, 

a;=0 

2  <  oo  and  2  w{x)  <  oo. 

x=0  x=0 

It  should  be  noted  that  a  sequence  of  positive  numbers  {t(;(x)}^o  satisfying  Condition 
C2  always  exists.  For  example,  we  may  let,  for  each  x  =  0, 1, . . .,  w{x)  =  n!^x"(M(i)!i(^+i))  K'^)i 

OO 

where  {6(x)}^o  i®  ^  sequence  of  positive  numbers  such  that  ^  h{x)  <  oo.  Then  it  is 

a;=0 

straightforward  to  verify  that  {w(x)}^o  meets  the  requirements  of  Condition  C2. 

Based  on  the  analysis  given  in  the  Subsection  3.1,  to  study  the  asymptotic  optimality 
of  the  empirical  Bayes  test  8n  which  is  now  constructed  under  Condition  C2,  one  needs 
only  to  investigate  the  asymptotic  behaviors  of  the  following  terms  under  Condition  C2: 

P{  —  <p(x)  >  d{x)  and  E2  occurs)  for  each  x,h*  <  x  <  a*  and 

P{  ifnix)  —  (p{x)  <  —d{x)  and  E2  occurs)  for  each  x,  6*  + 1  <  <  a*  +  1- 
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Let  /?  =  4  min  min(|gi(a:)|,pi(x)).  Then,  >  0.  Under  Condition  C2,  there  exists 

^  b*  <x<a*-^l 

a  positive  integer  N  =  N(/3)  >  M  such  that  for  all  y  >  x  >  N,  the  following  hold, 


( 


y 


ip{a*  +  1)  5] 

i=x 


w(i) 

a(i) 


I  ^  w(i) 

\  Z-/  a(i+l) 

I 


</?, 


(4.1) 


[1  +  If  (a*  +  1)]  ^(0  < 


Note  that  \fn(x)  —  /(ic)|  <  1  for  all  x.  Therefore,  by  (4.1),  for  y  >  x  >  N , 


I^V'n(y)  ^V'n(^  1)1 


I 1)  .  /(*  +  l)l  /-M 


<  I E  [/”('■ + 1)  -  H 


(4.2) 


y  /  -x  y 

^  w{t)  ^  ... 

^  E  ;yyT)+'"E  -W 

issx  ^  ^  2=X 


<  (1+  €n)^; 

(^(a*  +  l)|Aii-„(y)  -  AK„(a:  -  1)| 


=  via’ + 1)1  E  + *”  - 


<9(a*  +  l)|5])  [/n(0-/(0]^l+V?(a*  +  l)e„  J]u;(i)  (4.3) 


w(i) 


77^  nr  ^  ^ 


y 

+  +  1)^71  E“-(‘) 

i=x 


<  (1  +  Sii)/3- 
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Note  that  since  e-n  =  o(n  for  n  sufficiently  laxge,  2(1  +  Cn)  <  3. 

Following  the  proof  of  Lemma  3.3,  for  each  x  with  6*  +  l<x<a*  +  l, 


{9„(x)  —  <^{x)  <  —d{x)  and  occurs} 

OO 

^  -  1)]  -  d2ix)[AK„{y)  -  AKnix  -  l)]  <qx{x)} 

y — -c 


(4.4) 


For  each  y  >  N  +  1, 


[^V'n(y)  -  -  1)]  -  <i2(x)[AK„(y)  -  Ak„{x  -  1)] 

=  (y)  -  i^)]  -  <i2ix)[AKn  (j/)  “  ^Kn  (N)]  (4.5) 

+  [^V'n(-^)  -  -  1)]  -  <i2(x)[AK„{Af)  -  Ak-„(x  -  1)] 

where  |A^„(j/)  -  (iV)|  <  (l  +  e„);d  and  d2(x)|Aif„  (y)  -  Ai<'„(iV)|  <  (l  +  en);0,  by  (4.2) 

and  (4.3),  respectively,  and  noting  that  0  <  (p(x)  <  <p{a*  +  1)  for  x  <  a*  +  1.  Hence,  for 
each  y  >  iV  +  1,  6*  +  1  <  X  <  a*  +  1,  for  n  being  large  enough  so  that  2(1  +  e„)  <  3, 


-  1)]  -  <^2(a;)[AA'„(y)  -  Ak„{x  -  1)]  <  yi(a;)} 

.  .  (4.6) 

C  {[A^„(iV)  -  Av,„(x  -  1)]  -  d2(x)[A^„(iV)  -  Aa-„(x  -  1)]  <  ^}, 


by  noting  that  yi(x)  <  0.  Also,  for  x  <  y  <  N 


-  1)1  -  ‘t2{x)[AK.(y)  -  Ak„{x  -  1)]  <  Si(l)} 

,  ,  (4.7) 

C  {(A*,(!/)  -  A„.(i  -  1)1  -  <i2(x)[A;f.(y)  -  A^.(x  -  1)]  < 
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Combining  (4.4)-(4.7)  yields,  for  n  being  sufficiently  large,  that 


<  —d{x)  and  E2  occurs} 


C  U_  {[Av,„(y)  -  -  1)]  -  d2{x)[AKM  “  Ai^„(x  -  1)]  < 


yznx 


=  (E  ([/"('  + 1)  -  -  !/(•■  + 1)  - 

i=x  ^ 

+  e„(l  —  ^2(1))  ty(2)  <  for  some  r  <  y  <  iV) 


(4.8) 


c  (E  + 1)  -  -  [/(>■  +  1)  -  ^ 

i=x  ^ 

for  some  x  <  y  <  iV) 


C  {[/n(*  +  1)  -  d2(x)fn(i)]  -  [f{i  +  1)  -  d2(x)/(i)]  < 
for  some  x  <  i  <  iV}. 

Therefore, 

P{(^„(x)  —  ifix)  <  —d{x)  and  E2  occurs} 


qx(x)a 


iw{i){N  —  X  +  1) 


<  P{[fnii  +  1)  -  d2(x)/„(i)]  -  [f(i  +  1)  -  d2{x)f{i)]  < 
for  some  x  <  i  <  N} 


qx(x)a(i 


4:w(i){N  —  X  +  1) 


N 


^  Y1  +  1)  “  d2i^)fn{i)]  -  [/(*■  +  1)  -  d2{x)f{i)]  <  1)  } 


(4.9) 


N  . 

<  ^  exp{— 2nl 

-j.  \ 


qx{x)a{i)  Y  _  1  , 


4w{i){N  —  X  +  1)  J  (1  +  d2{x)y 


The  last  inequality  in  (4.9)  is  obtained  by  an  application  of  Hoelfding’s  inequality  and 

n 

the  following  facts  that  /„(i  + 1)  —  d2{x)fn{i)  =  -^  ["^{i+i}(-^i)  —  d2(x)/{i}(Xj)],  where 

j=i 
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I[i+i}(Xj)  -  d2{x)I{i]{Xj),j  =  are  iid,  and  E[I{i+i){Xj)  -  d2(x)I{i}{Xj)]  = 

f(i  +  1)  -  d2{x)f(i),  and  -d2{x)  <  I{i+i}{Xj)  -  d2ix)I{i}(Xj)  <  1. 

Next,  for  each  x,b*  <  x  <  a* ,  from  the  proof  of  Lemma  3.3a,  for  n  being  large  enough, 
{(^„(x)  —  <p{x)  >  d{x)  and  E2  occurs} 


C  U  {[A^„(a;)  -  A^„(y  -  1)]  -  di(x)[AK„(^)  -  AkSv  “  1)]  >  Px{x)} 
y=o 

=  it  ([^  +  -  -  +  -  -  f  1“«)  > 


for  some  0  <  y  <  x} 


^  Px{^) 


for  some  0  <  y  <  x} 


Px{x)a{i 


c  .u^  + 1)  -  d,(x)ui)]  -  if(i + 1)  -  d,(x)m]  > 


Therefore,  by  Hoeifding’s  inequality, 

P{ipn{x)  —  (j?(x)  >  d(x)  and  E2  occurs} 


(4.10) 


-  S  +  1)  -  - 1/(*  +  1)  -  >  2w(if+\)^  (4  U) 


<  ^  exp{— 2n 


i=0 


Px(x)a(t) 

[2tt;(i)(x  +  l)J  [l  +  di(x)]2 


Let 


T4  =  2  min  min 

6*+l<x<a*+l  x<i<N 


qx{x)a{i) 


4:w(i){N  —  X  +  1)(1  +d2{x)) 


2 

? 


7*5 


2  min  min 
0<i<x 


Pxlx)a(i 


2w{i){x  +  1)(1  +  di(x)) 


2 
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Since  N  and  a*  are  finite  numbers,  r4  >  0  and  rs  >  0.  Now  combining  the  results  of 

Subsection  3.1,  (4.8)  and  (4.10)  and  noting  again  that  both  N  and  a*  are  finite,  we  can 

conclude  the  following  theorem. 

Theorem  4.1  Suppose  that  f  O^dG(O)  <  oo.  Condition  C2  holds,  and  a*  is  finite.  Then, 

r(G,Sn)  —  r(G,SG)  =  0(exp(— ren))  where  re  =  min(Ti,r4,r5)  >  0. 
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